WO 2005/006736 

PCT/EP2004/004794 

1 

Method for run-length encoding of a bitmap data stream 

Field of the invention 

This invention relates to a method for encoding a data 
stream, particularly a bitmap coded subtitling data stream. 



Background 

Broadcast or read-only media containing video data may also 
comprise subpicture data streams, containing textual or 
graphical information needed to provide subtitles, glyphs 
or animation for any particular purpose, e.g. menu buttons. 
Since displaying of such information may usually be enabled 
or disabled, it is overlaid on the associated video image 
as an additional layer, and is implemented as one or more 
rectangular areas called regions. Such region has specified 
a set of attributes, like e.g. area size, area position or 
background color. Due to the region being overlaid on the 
video image, its background is often defined to be 
transparent so that the video image can be seen, or 
multiple subpicture layers can be overlaid. Further, a 
subtitle region may be broader than the associated image, 
so that only a portion of the subtitle region is visible, 
and the Risible portion of the region is shifted e.g. from 
right to left through the whole subtitle area, which looks 
as if the subtitles would shift through the display. This 
method of pixel based subtitling is described in the 
European Patent application EP02025474.4 and is called 
cropping. 
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Subtitles were originally meant as a support for 
handicapped people, or to save the costs for translating a 
film into rarely used languages, and therefore for pure 
subtitle text it would be enough if the subtitle data 
stream contained e.g. ASCII coded characters. But subtitles 
today contain also other elements, up to high-resolution 
images, glyphs or animated graphical objects. Handling of 
such elements is easier if the subtitling stream is coded 
in bitmap format, with the lines of an area and the pixels 
within a line being coded and decoded successively. This 
format contains much redundancy, e.g. when successive 
pixels have the same color value. This redundancy can be 
reduced by various coding methods, e.g. run-length encoding 
(RLE) . RLE is often used when sequences of data have the 
same value, and its basic ideas are to code the sequence 
length and the value separately, and to code the most 
frequent code words as short as possible. 

Particularly when encoding the subtitle layer for 1920x1280 
pixels high-definition video (HDTV), a coding algorithm 
that is optimized for this purpose is needed to reduce the 
required amount of data. 



Summary of the Invention 

25 

The purpose of the invention is to disclose a method for 
optimized encoding of subtitle or subpicture layers for 
high-resolution video, such as HDTV, being represented as 
bitmap formatted areas that may be much broader than the 
30 visible video frame. 

This method is disclosed in claim 1. An apparatus for 
encoding that utilizes the method is disclosed in claim 7. 
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An apparatus for decoding that utilizes the method is 
disclosed in claim 8. 
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According to the invention, four-stage run-length encoding 
(RLE) is used for this purpose, with the shortest code 
words being used for single pixels having individual color 
values other than transparent, the second shortest code 
words being used for shorter sequences of transparent 
pixels, the third shortest code words being used for longer 
sequences of transparent pixels and shorter sequences of 
pixels of equal color other than transparent, and the 
fourth shortest code words being used for longer sequences 
of pixels of equal color other than transparent. Usually, 
most of the pixels within the subtitle layer are 
transparent. Other than for conventional RLE, where the 
most frequent data use the shortest code words, this method 
comprises using the second shortest code words for short 
sequences of the most frequent color, and the third 
shortest code words for longer sequences of the most 
frequent color and also short sequences of other colors. 
Shortest code words are reserved for single pixels of other 
than the most frequent color. This is advantageous when 
pixels of the most frequent color almost always appear in 
sequences, as being the case for transparent pixels in the 
subtitle layer, while single pixels of individual color are 
more likely to be not transparent. 

Advantageously, a code according to the inventive method 
incorporates only few redundant code words, which are 
defined to be among the longer code words. E.g. a single 
pixel of any color other than transparent is ideally coded 
with a code word of the shortest type, but a code word of 
the third shortest type may be used as well, with the 
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sequence length being one. Though the latter possibility 
will usually not be used for this purpose, these unused 
code words, or gaps in the code word space, can be used for 
transportation of other information. An example is the end- 
of-line information that can be used for ^synchronization. 
According to the invention, the shortest redundant code 
word is used to code this information. 

As another advantage, the disclosed method reduces the 
amount of required data, thus compressing the subtitle data 
stream, with the compression factor depending on the 
contents of the data stream. Particular high compression 
factors are achieved for data combinations that appear very 
often in typical subtitling streams. These are sequences of 
length shorter than e.g. 64 pixels that have the same color 
value, but also sequences of transparent pixels having any 
length and single pixels having individual color values. 
The first of these groups are often used in characters or 
glyphs, the second of these groups is used before, between 
and after the displayed elements of the subtitling stream, 
and the third of these groups is used in images, or areas 
with slightly changing color. Since transparent pixels 
hardly ever appear in very short sequences, e.g. less than 
three pixels, it is sufficient to code them not with the 
25 shortest but only with the second shortest code words. 

Simultaneously, the inventive method may handle efficiently 
sequences that are longer than 1920 pixels, and e.g. may be 
up to 16383 pixels long, thus enabling very wide subtitling 
30 areas . 

Further, the coding method generates a unique value 
representing the end of a line, and therefore in the case 
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of loss of synchronization it is possible to resynchronize 
each line. 



Advantageously, the inventive method is optimized for 
coding this combination of a number of features being 
typical fo* subtitling streams. 

Therefore the amount of data required for the subtitling 
stream may be reduced, which leads to better utilization of 
transmission bandwidth in the case of broadcast, or to a 
reduced pick-up jump frequency in the case of storage media 
where a single pick-up reads multiple data streams, like 
e.g. in Blu-ray disc (BD) technology. Further, the better 
the subtitling bitmap is compressed, the higher capacity in 
terms of bit-rate will be left for audio and video streams, 
increasing picture or audio quality. 

Advantageous embodiments of the invention are disclosed in 
the dependent claims, the following description and the 
figures . 



Brief description of the drawings 

Exemplary embodiments of the invention are described with 
reference to the accompanying drawings, which show in 

Fig.l cropping of a subtitle area in a video frame; 
Fig. 2 a pixel sequence in a subtitle area; 
Fig. 3 a coding table for subtitling, including text and 
graphics; and 

Fig. 4 a table with an exemplary syntax of an extended 
object data segment for the Blu-ray Prerecorded standard. 
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Detailed description of the invent-. 



ion 



While subtitling in pre-produced audio-visual (AV) material 
for broadcast or movie discs is primarily optimized for 
representing simple static textual information, e.g. Closed 
Caption, Teletext or DVB-Subtitle, progress in multimedia 
development for presentation and animation of textual and 
graphic information adequate to new HDTV formats requires 
an advanced adaptation for bitmap encoding, Fig.l shows a 
video frame TV and a subtitle area SUB containing text and 
graphical elements G, with the subtitle area SUB being 
bitmap coded. The size of the subtitle area SUB may exceed 
the video frame dimensions, as e.g. for the Blu-ray Disc 
Prerecorded (BDP) format subtitle bitmaps are allowed for 
one dimension to be larger than the video frame. Then the 
lines are cropped before being displayed, i.e. a portion 
matching the respective frame dimension is cut out of the 
virtual line and displayed, overlaying the video image. In 
Fig.l, the subtitle area SUB of width B SOB is cropped, so 
that only a portion of width B w is visible. For standard 
HDTV, as used e.g. for BDP, B TV is 1920 pixels, while B SDB 
may be much more. 



Due to the rectangular shape of the subtitle area SUB, most 
pixels in that area are transparent. This is in an enlarged 
scale shown in Fig. 2, in a simplified manner since usually 
a line SL1,SL2 on a HDTV screen TV must be several pixels 
wide in order to be clearly visible. A line is herein 
understood as a horizontal structure. Each line of subtitle 
data usually contains one or more pixel sequences of equal 
color. Fig. 2 shows a part of a subtitle line SL1 containing 
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transparent sequences PS1,PS5, but also single visible 
pixels PS4, shorter visible lines PS2 and longer visible 
lines PS3. Most pixels within a line are transparent. This 
is the case between characters, but also at the beginning 
and at the end of subtitling lines. Anyway, since lines 
begin and end with transparent sections, each line contains 
one more transparent than colored section. But transparent 
sections PS1,PS5 are usually longer, while for pixel 
sequences other than transparent, used e.g. for characters, 
the most frequent case is a sequence length of 64 or less. 
This can be recognized from a rough estimation, assuming 
that at least 25 characters are displayed simultaneously, 
and that the space between characters has about one quarter 
the width of a character, so that a single character may 
use not more than 1920/25* (8/10) =62 pixels within a line. 
Often, a line SL2 contains only very few visible pixels, 
and therefore only few transparent sequences that are very 
long. 



20 A code being a preferred embodiment of the invention is 

listed in Fig. 3. It is a run-length code, comprising code 
words of lengths ranging from 1 byte up to 4 bytes, with 8 
bits per byte. It is capable of coding 256 different 
colors, with one preferred color. The preferred color is in 

25 this example 'transparent' , but may be any other color if 
adequate. A color look-up table (CLUT) may transform the 
decoded color values into the actual display color. 
Further, pixel sequences of equal color may be coded in two 
ranges, with the shorter range being up to 63 pixels and 

30 the longer range being up to 16383 pixels. 

The shortest code words of 1 byte length are used to code a 
single pixel having any individual color other than the 
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preferred color, which is here transparent. The color value 
CCCCCCCC may range from 1 up to 255, and may represent a 
color directly or indirectly. E.g. it may represent an 
entry in a color look-up table (CLUT) that contains the 
actual color code. One of the 8-bit values, containing only 
zeros (00000000), serves as an escape sequence, indicating 
that the following bits have to be considered as part of 
the same code word. In that case, the code word tree has 
four possible branches, marked by the two following bits. 

In the first branch, indicated by the following bits being 
00, valid code words have two bytes, and a shorter sequence 
of up to 63 pixels is coded having the preferred color, 
e.g. transparent. The only invalid code word in this branch 
is the one that comprises only 0's, since 0 represents no 
valid sequence length. This code word ^00000000 00000000' 
may be used for other purposes. According to the invention, 
it is used to indicate the end of a line since it is the 
shortest redundant code word. 

In the second branch, indicated by the following bits being 
01 b , the code word comprises another byte, and the fourteen 
L bits are used to code the length of a pixel sequence of 
the preferred color, e.g. transparent. Thus, the sequence 
length may be up to 2 14 -1 = 16383. The code words where the 
L bits have a value below 64 are redundant, and may be used 
for other purposes. 

In the third branch, indicated by the following bits being 
10 b , the code words comprise an additional byte, and the 
six L bits of the second byte represent the length of a 
shorter sequence of up to 63 pixels, which have another 
than the preferred color. The actual color is directly or 
indirectly represented by the CCCCCCCC value of the third 
byte. The code words with a sequence length LLLLLL below 
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three are redundant, since a sequence of one or two pixels 
of this color can be cheaper coded using one byte per 
Pixel, as described above, and a sequence length of zero is 
invalid. These code words may be used for other purposes. 
In the fourth branch, indicated by the following bits being 
lib, the code words comprise two additional bytes, wherein 
the remaining six bits of the second byte and the third 
byte give the length of a longer sequence of 64 up to 16383 
pixels, and the color value CCCCCCCC of the fourth byte 
gives the color, directly or indirectly and not being the 
preferred color. The code words with a sequence length 
below 64 are redundant, since these sequences may be coded 
cheaper using the third branch. These code words may be 
used for other purposes. 

The redundant code words mentioned above may be used to 
extend the code, e.g. add internal check sums or other 
information. 



The extended run-length encoding table shown in Fig. 3 and 
described above provides mainly two advantages. First, it 
allows for the most compact encoding of typical subtitle 
streams, including transparent areas, small graphical 
objects and normal subtitle text. Single pixels of any 
color, as used for small colorful graphics, are coded with 
a single byte. The dominant color, e.g. transparent for BDP 
subtitling, is always encoded together with a run-length. 
Run-length codes are available in two different sizes, or 
two pixel quantities. In a first step, run-lengths of up to 
63 pixels are available as 2-byte code words for the 
dominant color, and as 3-byte code words for the other 
colors. In a second step, run-lengths of up to 16383 pixels 
are available as 3-byte code words for the dominant color, 
and as 4-byte code words for the other colors. The end-of- 
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pixel-string code, or end-of-line code, is a unique 2-byte 
code word that can be used for ^synchronization. Secondly, 
the availability of longer sequences for the subtitling 
area, up to 16383 pixels per code word, means a reduction 
of redundancy, and therefore of the amount of data. This 
means that for applications with separate data streams 
sharing one channel, e.g. multiple data streams on an 
optical storage medium sharing the same pick-up, bigger 
portions of the subtitling stream may be loaded with the 
same amount of data, thus reducing the access frequency for 
the subtitle stream. 
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Another aspect of the invention is a further optimization 
of the data stream for transport using transport packets, 
e.g. in a packetized elementary stream (PES) . Due to the 
large file size of bitmaps, the packaging of such data, 
e.g. in object data segments (ODS) , is a problem. Often the 
maximum size of an ODS is limited by other factors, e.g. 
PES packet size. To fit large bitmaps into such packets, it 
would be necessary to cut bitmaps into small bitmap pieces 
before coding, which reduces the compression efficiency. To 
overcome this bitmap splitting, a new extended object data 
segment (ExODS) for BDP or comparable applications is 
disclosed, as shown in Fig. 4. ExODS is a data structure 
representing each of the fragments into which an ODS is cut 
for fitting it into a sequence of limited size segments and 
PES packets. The complete ODS can be reconstructed by 
concatenating the sequence of individual pieces of 
consecutive ExODSs. 

The start and the end of a sequence of ExODS is indicated 
by separate flags, f irst_in_sequence and last_in_sequence . 
When the f irst_in_sequence flag is 1, a new sequence is 
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starting. An ExODS having set the f irst_in_sequence flag to 
1 also indicates the size of the decompressed bitmap, by 
containing its dimension object_width and object_height . 
The advantage of indicating bitmap dimension is the support 
of target memory allocation before the decompression 
starts. Another advantage is, that the indicated bitmap 
dimensions can also be used during decoding for cross 
checking bitmap dimensions. When the last_in_sequence flag 
is set to 1, the last ExODS of a complete ODS is indicated. 
There may be ExODS having set neither the f irst_in_sequence 
nor the last_in_sequence flag. These are ExODS pieces in 
the middle of a sequence. Also the case of having set both, 
the first_in_sequence flag and the last_in_sequence flag, 
is possible if the ODS can be carried within a single 
ExODS. To overcome the limitation in size available for a 
single ODS by PES packet size within subtitling, the 
described type of ExODS may be introduced as a container 
for pieces of one ODS, e.g. for packaging large ODS for 
HDTV application. Besides the ODS pieces, the ExODS also 
carries flags indicating if it is carrying the first piece, 
the last piece, a middle piece or the one but complete 
piece of an ExODS sequence. Furthermore, if the first piece 
in sequence of the ExODS is transmitted, the dimensions of 
the resulting ODS, i.e. height and width of the encoded 
bitmap, is contained in the segment. The indicated bitmap 
dimensions can also be used for a decoding cross check. 



The inventive method can be used for compression of bitmap 
data streams containing e.g. text, images or graphics data 
for animation, menus, navigation, logos, advertisement, 
messaging or others, in applications such as e.g. Blu-Ray 
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Prerecorded (BDP) discs or generally high-definition video 
(HDTV) recordings or broadcast. 



